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ABSTRACT „ , . J 1 ' 

The Emergency School Aid Act (ESAA) Math Component 
was designed to improve mastery of math basic skills among the lowest 
achieving math students in 8 ^segregating public ""junior high 
schools, junior-high- level gracles in 6 nonpublic schools, and the #x 
ninth grade in one public high. school. The M&th Component consisted 
of 25 teacher aides, a parted me. Math Coordinator, 4 a curriculum of ^ 
workbooks and tests of the Mathematics Basic skills Development 
Project (MBSDP) The Math Component not- only 'met, but surpassed its 
two objectives foirrma-stery gain among remedial students. Objective'! 
' required 50 percent of ESAA students to maintain or improve their 

\ relative standing (percentile) among same- grade opeers f^om fall to 
spring on the Minneapolis Arithmetic Computation Test (MACT) . About 
two-thirds of the students met this objedtive, and therefore had a 
spring percentile rank which was the same as, or higher than, c their 
fall rank. The interpretation of these MAC& gains is, however, 
clouded by a possible regression artifact* Objective IT required 50 

: r percent of the students to earn "Mastery-Gain Points" °on MBSDP units 
at the rate of 40 per year.. .Again, two-thifds of the students met 
this objective.' Recommendations for program improvement included: (a) 
a m<yi efficient .system" for MB£DP materials distribution; (b) a 
formal commitment by participating Sfchoolssto use ESAJt aides, to use 
MBSDP' materials, and to organize participating teachers and* staff ; 
(c) a full-time coordinator ; and (d) careful planning to avoid 
'unintended, overiepresent&tion of racial minorities in the ESSA Math 
Component. (Author/DEP)/^ \ / 
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. ^ ' The Mathematics Component of the Minneapolis Schools' ^ 
' ' \ 1 1973-7^ %.Qrgenpy School^Aid Act Project^ 
• " % ' " " An Evaluation . 

V' . Summary 

. "The ESAA Matfr Component was designed to improve mastery of math See. Page 

l/basic' skilld among; the lowest-achieving math students in 8 desegre-* 
gating, public junior high schpo&s, junipr-high^level ^Rades in 6 non- 9 
public schools, and the nijitK/grade In • one public high School, 

Th^ ftatti' Component ^ccjnsisted of 25 teacher aides, > a part-time 
Math Coordinator, a curriculum consisting of the soft~cover workbooks' 7-10 
and tests of the Mathematics Basic Skills Development Project (MBSDP), m • 
and a pre-service workshop on the use of these materials. Implemen- n 17-21 
. tation of the program depended on the voluntary participation of kk * ' V 

vteachers* of remedial mathl The Math Component cost 13$ of the total 2 ^ 

Minneapolis ESAA grant of $535 i^l- ' 

During 1973- 7** the Math Component aided the remedial instruc- r • 

tion of about 1200 Minneapolis students, including about 120 lowest 
scorers in each public school on the fdb.1 Minneapolis Arithmetic 

Computation Test (MACT). -. , . r li-lj 

The evaluation studied those 1000 students for whom # achievement 
data Vera available, The Minneapolis Public Schools contracted an & 
independent evaluatpr*%o conduct this federally required evaluation, 2 

The Math Component not only met, but .surpassed. its two objectives - • . 

for mastery^ain among remedial students. Objective I required * < 

of, ESAA students to maintain or improve their relative standing fr 
(percentile) among same-grade peers ■ from fall to spring on the MACT. 3-7 
About two-thirds of the students met this objective, and therefore 
had a spring percentile tfank which tfas ths same as, or higher than, 
their- fall rank. The interpretation of these MACT gains is, however, * 21-25 
jzlfiVL&ed by a^ possible regression artifact. Objective II required 50$ v 
of the student^ to earn "Mastery-Gain Points 11 on MBSDP units'at the 
rat£ of hO per year. Again, two-thirds of the students met this 
objective. 

Three schools with higher MACS?* gains and MBSDP progress among 
their students, relative tb.fchree schools with lower gains, had ~r 
9 ESAA math programs which (a) seemed better organized, (b) involved 25-28' 
teachers more enthusiastic about teaching remedial matlfy (toll had 1 ' \ 

teachdi's who were more favorable toward MBSDP materials, (d) used 
the ESjAA math aides ^moreNefficiently. 

Recommendations for program ' improvement i^pluded: (a) a more " , 
efficient system for MBSDP materials distribution; (b) a formal 

commitment by participating schools .to* use ESAA aides, to use MBSDP 28-29 
materials, and' to organize parj?S?x^ating teachers and staff; (c) a 

full-time coordinator; ; and* Cd) cal&ful placing to avoid unintended • .) 
bverrepresentation of /facial minorities in tlip ESAA Math Component. 

The evaluator believes the program worthy of re-funding. 29 
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The, Mathematics Component of the fclipaeapolis Schools 1 
1973-7 2 * Snergency School. Aid Act Project: 
An Evaluation 

The Mathematics Component of the Minneapolis Schools 1 1973-7^ Etaergency- 
School Aid Act Project was designed to -improve mastery of mathematics basic -4 * 
sld-lls jajnong junior high students with extremply* poor math achievement* The 
staff of the Math Component consisted of 25 teacher aides' and a six-tenths 
time Math Coordinator. The^iirriculum consisted of the consumable-booklet j 
instructional units of, the Minneapolis Schools 1 Mathematics Basic Skills t 
Development Project (MBSDP). The MBSDP units were written by a team of 
Minneapolis teachers.% The Project and the development of the units, funded v 
under Title I of the Elementary and Secondary Education Act f are described * ^ 
in a 1973 paper by Hestwood and Taylor.- 

Although the Math Component did not hire teacher's, a total ox 44 
Minneapolis teachers, in both pttblig and private schools, participated in 
the 1975-7^ ESAA Math Component by using both the services of the ESAA math 
aides and the units of the MBSDP. The ESAA Math Coordinator, who partici- 
pated in developing the MBSDP units, consulted with teachers seeking to make 
the bo^t use of ESAA aides and the innovative materials. 

A pre-service workshop on the use of the curriculum materials was - 
attended by all aides and by 8 of every 10 participating teachers. 

During 1973-7*f the Math Compbnent aided the remedial instruction of 
approsdmately 1200 students in public and nonpublic Minneapolis Schools. \ 
This evaluation studies the gains in mathematics skill of approximately 
1000 students who completed MBSDP units and/or took both pre- and posttost 
administrations of a standardised basic-math test. 

Because the Emergency School Aid Act (1972; denoted hereafter as ESAA) 
was designed in part to help solve instructional problems that Mght arise * 
from planned desegregation, the Math Component operated in ^iose eight public 
junior high schools desegregating as Of fall, 1973 : Anthony, -Bryant , Franklin, 
Jordan, Jefferson, Lincoln, Phillips, and Ramsey. {For an overview of the 
Minneapolis desegregation plon, sep the summary published by the Minneapolis 
Public Schools, 1972.) The nintja gradd in one public hi^h school, North 
High, received ESAA math "assistance. Junior-high-lev^JL grades in six nonpublic 
schools also participated in^the Math Component in 1973-7<K * the seventh and 
eighth grades in Ascension, Holy Rosary, Incarnation, St. Joan of Arc, and 
St.' Stephens; and trie ninth grade at Regina Hjigh. 
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Background: The Minneapolis Schools 1 ESM Project 

The Math Component -was one of three comprising the Minneapolis Schools' 
ESM Project. The other Components provided remedial reading instruction 
and Desegregation Counselor-Aides for junior high students. The Counselor . 
Aides we#e employed to prevent or reduce any^raeial conflict that might 
, arise in the desegregating public junior highs. The original plans for each 

. of -the three Components *are described in the proposal for Minneapolis' ESM* 
^ Project (Office of Planning, Development, and Federal Programs, 1973). 

Among the three Components, the Math program was considered third in 
priority for funding, behind both Beading and Conflict Resolution (Counselor- 
. Aides). The Math Component was also the least expansive, costing #60,957 in 
the public schools (and also t aiding a very small share of the $50,791 allotted 
to nonpublic schools for- reading and math instruction). Of the total #535,^1, 
in ESM fuftds awarded to Minneapolis for lj)73-7*f % approximately iy/t v/eijt 
the Math Componfent. , J 6 -j / 

The priority of each Component fox> funding was determined by $ vote of 
the ESM .'Districtwide Advisory Committee,, a' group constituted in accordance 
vrit$ ESM guidelines so as to (a)* represent all major racial/ethnic groups 
in, Minneapolis and (b) include o teachers, students, parents, and members cff 
community •organizations promoting equality of opportunity. t 

ESM evaluation . 'The ESM-Project budget allotted a maximunj of 310,000 
fir ovaluatiorf. These funds were used to study all three Components — Reading, 
, Conflict Resolution,- and Math. The evaluation was conducted by an independent 

contractor, a research psychologist selected by the Research and Evaluation 
Department of the Minneapolis Public Schools. Although the evaluator received 
technical consultation and clerical assistance from the Research and Evaluation 
Department, the *o valuator was not a regular/ employee of the school district. 

The |olrybiottship between ESAA and Title I assistance . Seven of the ESM 
public schools — Bryant, Franklin , t Jefferson % Jordan t Lincoln, Phillips) and 
. % Norths- also received federal aid cin 1973-7** under provisions of Title I of 
th9 Elementary and Secondary 'Education Act.* Title I funds are used to aid ■ 
the compensatory education of disadvantaged 'students. ESM funds, to aid 
desegregating school districts, are not necessarily earmo^cod for compensatory 
education, although they may be so used. In Minneapolis, the ESM Project did, 
however* emphasize compensatory reading and math instruction. The ^ 
ESM students in tljese schools were a subset of Title I-eligible, dis- 
advantaged students, consisting of the -lowest achieving junior-high-^age 

• • v 8 , 
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students; namely, the lowest-achieving 125 students in math f and the lowest- 

achieving 125* students in reading. In short, in, a school that received 

assistance from both ESAA and Title I, every ESAA student was a Title l^^J ; 

eligible student, but not every Title I student was an ESAA student. 

The Organization of This Evaluation Report 

The following sections of this report provide answers to 'four questions 
about the Math Component: # . 

l.-What were the objectives of the 'Component? 

*2. How did the Component* operate? The answer to ±his question includes 
a description of the Math Component's curriculum, students, staff, and day- ' 
to-day operation. The actual operation of the Component is also compared to 
the -original Project proposal f V prescriptions for program operation. 

37 P Was tht Component effective in. meeting the objectives stated in the 
.original Projec.t proposal? Included in the answer to this question is a 
'discussion of factors possibly accounting for differences among schools in 
their success in meeting GJomponertt objectives. 

*f. What recommendations should be made concerning (a) the improvement of 
Component operation and (b) the re-funding of the ^AA Math Component? 




THE OBJECTIVES OF THE MATH CCMPOfi 
The Math Component attempted, using math aides and MBSDP materia^©! to 
produce important gains in mathematics mastery among the poorest-achieving 
math students in eaoh ESAA school. 411 students selected for the Math Com- 
ponent we're to hf\ two or more years below the level of math achievement 
expected for their grade level as of the start of the 1973-7 2 * school year. 
The Component planned to servo 125 of those students in* each public school 
and smaller numbers of those remodial students in each nonpublic ESAA school. 
Selection of 'students for the Math Component was based* largelfr on a fall, 
1973, administration of the Minneapolis Arithmetic Computation Tost (abbrevi- 
ated MACT; published by tho Department of Mathematics, Minneapolis Public 
Schools, 1973b. (See pp f 11-17 for a more ^•toilo&^latecriptiLon of tho ESAA math 
students and their selection.; A -w 

Tho specific objectives <6t tho Math Component werei 
/ Objective I: 5C$ of tho evaluation-eligible ESAA studopts who take both 
tho fall, l ft?ff « and spring t 197^ \ MACT will have A jpercontiie rank in the .spring 
which is tho saino^ or 'higher than^ thein percentile ranlt i n tho fall . 

u 
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"Evaluation-eligible" ESAA students were those lowest math-achievers - 
who actively participated during 1973-7** in a math class which had both an 
ESM math aide and MBSDP materials. Such students were "reasonably exposed 11 
to the Math Component in that (a) they were enrolled in the ESAA-aided math 
» class for at least one grafting period (quarter or trimester) and (b) they 
attended at least half of the math-class sessions during the -total of all 
X973-7^ grading periocfs they were enrolled in the math class, 1 ; * 

Objective I,' in effect, stated that at least half of the evaluation-' 
eligible ESAA students would maintain their relative position among peers, 
over time, in tnath achievement • The 33- item MACT defines math achievement 
as the student 1 s- ability to perform the four fundamental operations on 
whole numbers, fractions, decimals, and percent's. Different", equivalent 
forms of the MACT were given- to all Minneapolis public-school seventh and 
eighth graders in September, 1973t and May, 197*K Separate percentile norms 
for each grade level (seventh and eighth) were computed for each test" admin- 
istration, and are reproduced in this report as Appendix A. An ESAA student's 

raw score at each testing was referred to the appropriate citywide percentile 

* * */ 

norms. (Since' no citywide ninth grade norms exiet'edj the raw scores of 

ESAA ninth graders were referred to eighth grade norms.) 

/ If ESAA students obtained*the seme MACT percentile in fall, 1973» and 

spring, 197^t^|he writers of ObjecMw^J apparently v/ould infer both (a) that 

ESAA student d^had kept pace/ in math skills with their peers, and (b) that ESAA 

students had made the yearly amount of growth in math achievement currently 

expected from remedial Minneapolis -math students at that grade level. Such. 

inferences unfortunately would be erroneous, A later section of this report 

discusses the unavoidable effect of a regression artifact in boasting the pre- 

test to posttest gain scores of students selected for their low pretest scores. 

Objective II:" of the evaluation-eligible ESAA siudents will earn 

"Mastery-Gain Points" on MBSDB uniifo at the rate of ^fO or more per year, based 

on tho total of those marking periods they were .enrolled and attending half 

S 1 

or more of their math classes. " \ ,v 

• — * ) 

An ESM student was "reasonably exposed" and therefore evaluation-eligible 
if, for example, the student attended Z% of the classes during the first grading 
• *T1Z d \£? ° f thG elass0B dul,in B ^e second grading period, and then dropped out 
of the ESM math class or transferred to another school after the second grading 
period. (No provision was made in the evaluation for educational follow-up of 
EoAA studontu after they transferred to other ESAA or non-ESAA schools). A 
student Who dropped out during a grading period was considered evaluation-eligible 
only if he/she had attended 5(# or more of all class sessions held during the 
total of all enrolled grading periods, a total which includes the remaining class 
sessions in the grading period, after the student dropped Wt. 



Thejjnits in the MBSDP curriculum are listed ^on Page 2 of Appendix B, 
v/Jtiich is the form used to record for each student (a) gains in math achieve- 
.ment as measured by MACT scores and progreso on MBSDP units and also (b) 
that inf ormation ^on class enrollment and attendance needed to determine 
evaluation eligibility. 

Completing an MBSDP uhit / Ea2h"unit listed in Appendix B is' preceded 

#»by a diagnostic pretest. The number of problems, ranging from 8* to 26, is 

« 

the same for both the unit pretest and the unit posttest/ If the student 
correctly answers 8^ of tfye items, assessing mastery of that unit, the 
student skips the unit. If the student does not show 8^ mastery, then 

^tho student completes the 20-50 page linear-program unit-booklet. Each 
uriit-booklet is divided into ports that are 3-8 pa^es-long. The student 
checks his/her answers after each part. On fcpmpletion of the booklet^ thG 
student takes one of three equivalent posttests (whichy^a also equivalent V_ 
to the 'diagnostic pretest). A student correctly answaring^S^ of the 
posttest problem^ moves on to the next unit. A Gtudenr^npt achieving such 
maoi^f (a) completes additional materials (often includingworfeheets and 
puzssles), (b) receives individual help from the teacher or aide, and then 
(c) takes additional posttests uijtdl the 8^-correct criterion is met* 

» . Unit difficulty . Each MBSDP \mit is associated with an "estimated 
difficulty 11 rating. The difficulty ratings range from 6 for the easiest 
units (e.g., Fractions Unit 1, addition with like denominators)* to 30 for 
the hardest (e.g., Division of Whole Numbers, Traditional Approach). The 
difficulty estimates for each unit were,b&sed on a consensus of the MBSDP 
authors and several math teachers familiar with the materials. 

Mastery-Gain Points . Objective II, in effect, stated that at least half 
of the ^valuation-eligible ESAA students would show "adequate gains 11 in 
mastery of math topics in which they formerly lacked competence. To document 
this type" of math achievement, a point system was devised to assess each 
student's "mastery gain" after studying units of the MBSDP curriculum. After 
successfully completing a unit (answering 85$ correct on a posttest),* a* 
student was awarded. "Mastery-Gain Points," talcing into aceoiint both (a) the 
"estimated difficulty" of the unit (see preceding paragraph) and (b) the 
student's score on the pretest for. the unit.:, J 

For each unit, a student eould earn the maximum "Mastery-Gain Points," 

t 

equal in 'number to the unit's "estimated difficulty," only if the student 

1 1 



had an extremely low score on the .pretest. Specif icaily, students with*' * 
pretest scores of 0-3*$ correct answers earned the full number of Points 
jjjjien theju^ompleted *the unit and pajssed the posttest. Student's in the 
35-64^ r^nge.on the pretest earned two-tlyirds of .the maximum Points allow- 
able for that unit* Students with pretfest scores .of 65-8^ earned only 
one-third of the maximum Points on unitVompletion.. Appendix "B includes 
^ the .conversion table used to assign a student* Mastery-Gain Points upon" 
uni^completiofr, based on the studentdb unit-pretest scor^. . m ' 

Objective II considers a s-KmiSnC to have made "adequate gains 11 if the - 
-student earned ^madte^y-gain point's 11 at the* rate of kQ per year* That is, ' 
those ESAA students enrolleA^|op*^iaasfe grading period who a att^doft. ^ 
50$ or more of the ESAA-aided math classes during tiie total period of their 
enrollaj^t Should earn, points at 'the *fO-per-year rate. An evaluation- ' 
eligible ESAA* student enrolled in an ESAA-aided math class for one quarter 
should earn '10 mastery-gain -points* A student enrolled and attending, for 
one trimester should earn 13-3 points; for two trimesters, 26.7 points. o 

"As an eDramplo qf adequate gains , a student could earn ^6 points in 
one' year by completing the following units, having beguir^ach unit with 
pretest scopes in the 3^-6^5 range: 'Dj^£sion of Whole Numbers u Traditional 
Approach (20 Mastery-Gain Points earned out of / a possible 30).; Fractions 
Concepts (10); Fractions^-Unit 1, addition 00 1 Fractions Unit 2, raisccd- 
number addition (*0; and Fractions Unit 3, subtraction (8). 
How Objectives I and " = xf-B4f f or From Those Stated in the ESAA Project Proposal 

The originally statod'objectivos of the Math Component required mod- 
ification for th^ present evaluation. First, the original Objective I in 
the 25SAA Project proposal stated, "50$ of tho J3SAA students will show ono 

* i r • ' ' ' 

or more years' growth, 2% v/ill show 5-9 months 1 growth, and will show 
less • than 3 months 1 growth on the Minneapolis Arithmetic Commutation Tobt 
given in fall, 1973i'*ond spring, 197^ n (p. S6). Minneapolis city-wido / 
MACT norms" are computed for oaoh grade level,' at each f toq,t administration* ^ 
While the norms perhaps * allow one to infer that a student has made a year's 
growth in computation skills (by maintaining his/her same percentile rank- 
^pmong some-grade peers froi fall to spring), the MACT norms do flot permit „ 
determination of "months 1 growth. 11 Those portions of tho origin/lily stated 
objective that could not bo fljoasured we^e therefore deleted for the present 
evaluation. V ' " . * 



■ ' %cond, Objective II. in, the original proposal stated tiMfe of the -p. 
, ESAA students >rill' master at least two are&s^ a&d "2*$> will ma£|£r one ar£&, * 
'by^.ea^liine *the 85$ level on the criterio»-*ef erenced te£ts assbSi'ated with 
the inilt^ctitinal units in each area 11 (p. 26). tfhis second origin^: olJjec^: v 

tive lef^? unclear the-*definition of "area." An area could be single-unit . 

toy? ^ 0 v . . - - - * • i' ' 1 | 

(e.g. , Fi^ctiogs Unit 5-, multiplication) or a group of units (e,g^, al|', ; . 
seven un$fes* on fractions),; The corresponding Objective II an the present; 
evaluatio|i; is not only more clearly stated but also more stringent in de-^.^ . 
.fining mapfery. Mastery is* defined in te^ms of both passing V posttest ^etridlA , 
also the scored 6n the pretest; m i.e., mastery gain is the variable of y intere^. 
The. achievement af students who complete a unit is weighted according -to the^rl- 
initial proficiency level. . < .. \ - / - 

The third problem with the original proposal's objectives was ambiguous V 
^definitidh of the ESAA students that w<juld be eligible for the evaluation, 
]j£ I»3SAA students are drawn from the ranks of * the lowest aqj^^vers in each 
school'! one would expect ESAA students, in general, to have poorer attendance 
aiid higher attrition than non*-ESAA students. The inclusion * of persistent 
.truants and other non-at tenders in the evaluation would provide an unfair 
base for assessment of the Math/Sbmponen^s effectiveness. m 

In tlie present evaluiation, a student's "reasonable exposure*! to the- ESAA 

materials and methods is a prerequisite for that student's inclusion in the 

f ■ 

evaluation. The present evaluation design does include all ESAA students 
whose class attendance was or more for one marking period. In short, 
the present evaluation design (a) includes those students whose participation 
would allow them to benefit from the Math Component and (b) prorates their 
MBSDP\ achievement gains based on the duration of their active participation. 

HCW' DID -THE MAtH COMPONENT OPERATE? ' ' 

This' discussion includes additional description of the innovative MBSDP 

* • • • * ^ 

material^ ' a more detailed description of the ESAA students and their method " 

of selection; and a description of the Component's day-to-day operation with- 
in the schools. The role of the ESAA math aide is described within the third 
section on daily classroom operation. 
. Innovative Materials:. The fcurgifculum of. the Mathematics Basic Skills 
Development Project 

°The Mathematics JBasic Skills Development Project (MBSDP ) units are 
consumable booklets (and tests), each, unit-booklet programmed to teach a 
specific mathematics topicl^ e.g., fraction /concepts, division of fractions 

*' - 13 ' ' 
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(Fractions Unit 6), decimal concepts, multiplying decimals, ^metric linear 
measurement. . Previous sections of this , report (see pp. fM>) have provided 
additional description -of the units', the diagnostic testa^, and. the assign- 
ment of Mastery-Gain Points upon nmit -completion, 

' Each ESAA jpchool was allotted MBSDP materials based on^the number of 
ESAA students (125 copies , of units for each public junior high; less for 
each nonpublic* school). " 

The MBSDP units . Both Table 1 and Appendix B list all MBSDP units. ■ < 
Table "1, in addition, shows the percent of ESAA students^ in each school 
and in the total group who completed each unit by passing the'posttest with 
8p% correct •answers (after failing the pretest and working through the unit- 
booklet). ' • , « ' 

Three important points should be noted concerning the materials listed 
in Table 1 and Appendix B: 

1. The MB£DP7T&its varied in availability .' -Some units were available 
in a final, pub^shed version throughout the 1973-7^ school year; these 
units have been identified in Table 1 with an asterisk (*). These published 
units, which were also sold outside the Minneapolis Schools, were those 

.completed by the greatest percent of. ESAA students. The four most popular , 

units were Fraction Concepts, and Inactions Units 1, 2,; and 3- Fraction 

• • > . 

Concepts was completed by over half of the ESAA students in each public 
school* * 

Another group of Units was^ published midway through the school year. 
Division of Whole Numbers (traditional approach) and Adding and Subtracting 
Decimals &re examples of those units available only during the second semes- 
ter. - 

A third group of units (e.g., Percent 1 and 2, Area of Parallelograms 
and Triangles) were available only as trial versions ^n 0.973-7^ • 

/Some students completed "old" MBSDP Units, such as 'Dividing and Rounding 
\ Decimals, that were early trial versions of units published or rewritten in, 

i§7^->4. \ V*" , 

t By the end -of 1973~*7 Z N all of the units planned as part of the ^Mathe- 

matical Basic Skills Development Project were available to ESAA students in 

either a puKTfsKeC^V, trial version. 

2. Four of the widely used units — Addition of Whole Numbers, Subtraction 
of Whole Numbers, Multiplication of Whole Numbers, and Division of Whole 
Numbers— were not MBSDP units, but were instead materials originally generated 
by a computer program called the Arithmetic Test Generator (ATG). As part of 
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Unite of tha Matheaatice Baaic SkiUa Development Project (MBSDP) Completed by ESAA Studente 



MBSDP unit* 

: " 


X of studsnts cosplsting "•sch MBSDP unit 


Total 
Group 

Nx876 


ESAA public schools (6 junior highs, 1 high aehool)* 


6 

Nonpublic 
Schoola 41 

Nsll9 .. 


School A 
N=ll8 


School B 
N=104 


School C 


School D 
N=128 


School £ 
H*l?5 


School H 
N=79 


School I 

N^73 


•Addition of Whole Kuabera 0 
(computer-generated aatariale) .... 


i# 


erf 


16* 


. f • 


22* 




'• '& : ' 


. <# 




♦Subtraction of 'Wholt K««bara c 
(computer-generated aateriale) 


26 


V? 


. 21. 


24 


35 


73 


14 


0 


8 


: ^tiplioatlon of Whole Number* 0 
j (coaputar-generated aatariele 


40 


*2 


"12 


42 


69. 


"? 86 


; . 28 


0 




•Diviaioft- frf Wfcola Numbera 0 " *\- 
(coaput er-g*nerat ed aatariala - 


13 


9 


1 


40 


28 


12 


1 


0 


0 


Divieien of Whole^Humbera 
(ti^itional approach) 


31 


& 

Ov 


• ' -2 


13 








A 

V 


. 32^; 


''Fraction* Concapta ■ • -\ 


6o 


5 ft 


32 


55 


71* 




bo 


73 




•Fraetiona Unit 1. 
(addition i lika denominatora) 


«»9 


69 


' 28 « 


32 


59 


66 


Jf7 


33 * 




(addition | aixtd numbera, 


41 




17 


Id 




q 


lig 


36 




•fractidoa Unit 5 
(eubtraction. like denominatora) 


48 


69 


U 


30 


77 


47 




r • 


39 


•Fraetiona Unit 4 
(additlon# eubtraction. 


37 


61 


4- 


22 / 


59 






92 


» 


♦toglieh |aaatiraaa^t (linear) 


'12.' 


16 ■ 


0 


8 


. 27 


2 


9 


.12 


22 


♦Fraot Ian*, Unit 5 
(multiplication) 


31 


60 


8 


14 


54 " 


14 


43 


47 


20 


•Fiction* Unit 6 
vdivialoA; 




51 ' 


13 




39 


6 


27 


33 


16 


* *Area Htaawanitiit (Unglleh) 


7 


9 


0 


V- 4; \ 


26 


0 


1 


12 




*. *'.- * 
filial dOttfitjrtg y 




' 40 




47 j . 


':■ 16 


% - 10. 


• ■ 32-. - 


29^. 


37 


. Adding e^. Attracting i^imala 




40 


13 


. 30 


, 0 


: 3 "' 


13 




25 


. Multiplying Decimale 




32 " ~ 


0 


' ' 26 


0 


2 ' 


' id 


0 18 


13 


Mvidin* and .founding Dacimala 
(did unit) 


7 


9 


0 


10 


0 


-0 


6 


29 


8 


. Ho ttHStfP tsjitS empUttA 


6% 




22*.' 


ft 


at 


. m 






22^ 


Msptstsd by ESAA students In ' 
school (including units listed 


N of diffSrsnt MBSDP units 


52 . 


24 


14 . 


26 


23 


19 


24 


17' 


24 



thaaa unit* afa ii at ad thit w«ra Cdaiplat«d by Mora than % (k7) of tha total group df SSAA ntudittti» other, unita and 
tlt# aaraaat df atua^nta donpliting thai ara aa fcllawi Jttading tong Kuabara (3*>1 Mttric *anpafAtura (2)| 'Metric 
ffeatttfaaa^^lifitaf <J)f fii¥iaioh-iubtiE'*ctiv# approach (3)j liquid M#aaiiraaiaiit*-*ttgiiah (!•«« than l^uatiotift 
V#laM Haaaur aa*nt-* old wiit (%h 'Voiuaa Mtaauraaant-Hiav unit (2)i Matfic dajMieity <2)f OiHding t)#eliali*-n§w unit Wl 
Oifldiif mi M*wtU% tt**i**l***n*v unit (l«aa than i)( Ptrcant 1 <4>| Parcant 2 (l)f Aran cf ^allalcgraiiB ind ¥rl*> 
aBgl«i ?2)f aVdty KBfifi^ unit tfaa Uaad by At ltaat 2 atudanta* 

^t«##li f md 6 MN 6»ltt#d fro* thia an alyaiir bacauna aoaa t«achtra in these achoola aiibitituted other programmed* eeif* 
1 * $ M 'tm wtU tot 6*tl*i& 6t th« KMpr unita t without eltarly dthcting the ttubetitution oa tha rtudeht>» JSSAA dutn ahaat 
alCD I/^ lis^nialtor Ufliti V«M fldt jpart cf tha HBJSfit* Curricululi, but war* inatead workahieti and t**t* geherat«d on JJUch. n 
Mi A y>: d#fJMttii< tilMlilal Ag pSSk of «htf <HoA|Hit«r Oanaratid AfithMtio M*t#J?iili:#oa#ct (aie taitt)* ' Ho vhole lb 
tmiti iieiit« ■ . * .. V * ' ■ . j_ 



an earlier Minneapolis Schools 1 math project, the ATG rallowedt a person fitting 
at a school's terminal to "call" gra£edH*orksheets, answer^, and' achievement 
tests covering a particular math topic (e.g., addition of whole numbers). Since 
the ATG had Keen supplan.t by another ' computer progralfi before 1973-7*f, ESAA 
students did not interact directly* with the computer to g6t ATG materials. 

- Instead: ^representative computer-generatedi ATG worksheets and tests were' re- .; 

^ printed on masters and multiple-copied for use by ESAA students. Since no ' 1 
•MBSDP units existed to teach addition, subtraction, and multiplication using 
whole numbers, the ATG worksheets and tests were the only materials 'used to 
teach. ESAA students these basic whole number skills. 

5. A sequence ig recommended., for the completion" of the MBSDP units . • *' 
Appendix B lists together both the mathematics units akd the MBSDP measure- ' 
ment units. The math units are listed in^-the order recommended for their 
completion. The measurement units can be used in a more flexible 'order. 
A given measurement unit can be used at any point past the mastery of certain^ 
math prerequisites. Appendix B. lists each measurement unit at the earliest i 
point it can be taken in the MBSDP curriculum. 

The cost of the MBSDP materials . In the Math Component proposal $5,105 

-was allotted to purchase MBSDP materials in the public schools (and approx- 
imately $500 was so allotted in the nonpublic schools). Since this proposal 
specified that each of nine public schools would serve 12XESAA students,' 
the MBSDP materials were expected to cost approximately $*f.50 per student. 
Sinoe slightly fewer than the expected number of students were actually served^ 
by the ESAA Math Component in 197^-7^, the actual MBSDP materials cost was 
probably about $5.00 per student. Table I indicates that 866 students in 
seven public and six nonpublic ESAA schools were known to have completed 
one . or more MBSDP units. Ctaitted from this table were 26l ESAA students 
in two public schools, because teachers in these schools substituted other 
programmed, self- instruct ion units for certain of the MBSDP units*, without 
clearly indicating this substitution to the evaluator (see .p. 13 below). 

If one prorates the budgeted materials allotment and therefore assumes 
that these schools in Table 1 received approximately $*f500, then the MBSDP 
materials cost about $5.50 for each ESAA student actually completing one or more 
MBSDP units. Since each the^ 806 students, on the average t completed 
if. 7 MBSDP units ( not including completions of the *f computer-generated units), 
the cost of each unit completed by an ESAA student was about $1.18/ 

17 n 
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The* ESAA Math Students': Their Selection and Characteristics ' 

;*■ /AV discussed above, the target population for this program/was junior* 

high-age students who in fall, 1973 » - were two or more years below the level 

of math achievement expected for their grade level.. „ According to estimates 

^ . (see Project p^posal) based on ,1972 citywide testing, eadh* desegregating . 

'-public junior high in-_1973-7 i f could expect to have at least X25 students 

two or more years below grade level ih math achievement; *on the average, . > 

each school, could expect more^han. twice that number. Jn the nonpublic 

schools, the estimated number of students two or more years bf.low grade 

imnath ranged from 12 to 3^ per school , with a median o? 22. '-' v 

Final j>l^ns for the Math Component reflected a decision to serve, *iot 

the entire. public-school. remedial population .defined above, but 'instead the 

poorest-ashieving 125 math students . in -each public ESAA schdol. This decision 

tpi^erve only half of the public junior-high students needing remedial matji ^ 

was baa^d on three considerations: r (a) the amount of ESAA funds alotted to 

Minnesota dictated*$^stere program budgets*; 7 (b) the Math Component #as the- 

lowest priority ESAA Component in Minneapolis; anti (c) seir|n of the ESAA 

public schools woul^also receive funds for remedial instrttttxbn under Title I 
> ' ■ • v '■ ■ ;V * 1 

of the Elementary and Secondary Education Act. * ' 4 

In .the nonpublic schools, however, all students judged by their teachers 

to be two or more years below grade level in math Were eligible for the ESAA / 

Math Component. ' , '^k . 

• A previous* section (see pp. 3~^) explained that selection of individuals 

'for ESAA math instruction 1 was based on the* September, 1973 » administration of 

the MACT- to all Minneapolis public- junibr-high seventh and eighth graders. 

In addition, ninth graders believed to need, remedial instructioij. in math also 

took the MACT at this time. The 125 lowest scorers in each ESAA junior high ; 

were supposedly designated as ESAA math students. In the nonpublic schools r. 

ESAA math students were selected without MACT testing.-* The fall» 1973, ^ 

version of .the MACT was, however , f given to nonpublic ESAA math students sis ^' 

(a) confirmation of cor^^ placement in the Math Component - and (b) the 

pxjetest for the ESAA evaluation. ^ 

Protest MACT performance of ESAA students . Table 2 shows the pretest 

(and posttest) MACT performance of ESAA students separately for each school 

and for the combined students in the six nonpublic schools. Table 3, instead 

ctf the school means of Table 2, presents frequency distributions for the 

entire ESAA group, showing the number and percent of students attaining each 

pretest (and posttest) percentile rank. " 

o ii 18 * 
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For a total group of 852 ESAA students, the mean of the pretest percentile 
ranks *as 17.1, based on all Minneapolis seventh and eighth graders taking the - 
same September, 1973 f test. ^Table 3 indicates that 86$ of the* ESAA students 
had a citywide percentile rank below 30 on the pretest. ; 

Among ESAA schools, the highest mean percentile rank-on tfxo ppetest 
°.was 27, obtained by School I' s students (see Table *2). The students in 
School I were all ninth graders, accounting for their relatively high 
position among the total group of ESAA students. (Since ninth graders do 
not ordinarily take the MACT t the MACT scores of ESAA, ninth graders were 
therefore referred to eighth ^r^de norms. ) 

Although the Project proposal did not specify upper limits on MACT 
scores for students 1 Math Component* participation, one might question the 
selection for the program of those 7# of ESAA students whp scored at or 
above tjie thirty^fifth percent iie on the protest. It seoms unlikely* that . 
these student^ were either the lowest achieving math students in their 
schools, or two or more years below grade level in math achievement. 

Students omitted from analyses involving the "total group'* of ESAA 
- students. Footnotes to Tables 1, 2* 3i and 5 indicate that ESAA students 
in Schools F and G were omitted from data analyses involving the total 
group *bf "pure ESAA 11 students. The 876 students whose* progress is charted 
in Table 1, for example, and the 8^2 students constituting the "Total" pre- 
test group in Table 2, are called "pure ESAA" because they used only MBSDP 
materials (and the four units of computer?>generated arithmetic materials 
lifted in Table l). In ESAA Schools F and G some teachers substituted 
other programmed, self- instruction units (e.g., on whole number division 
and fractions) for a number of the MBSDP and computer-generated units 
listed in Table 1. Teachers in Schools F and G, by special arrangement , 
with the evaluator* translated students \ progress on nbi!~MBSDP programmed 
materials into the Mastery Gain Points described earlier. v Nevertheless, 
^because the original Math Component ^alan Was not ^ followed/ afld^because 
teachers in Schdiols F and G did not clearly distinguish qtujtents who used 
only MBSDP units from those who did not — all 26l ESM-eligible ^studente 
in Schools F and G were omitted from data analyses involving "pure ESAA" 
students (those who used only MBSDP materials for the programmed learning/ 
of math basic skills.) 

In summary, the original plan for the Math Component was not followed * 
in Schools F and G. Nevertheless, the mastery gains and characteristics of 

20 ' 
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TABLE 3 

Pretost-Poottoot Porf&rmanco of All ESAA.Studont.o-. 
on tho Minneapolis Arithraotic Computation $os^ (HAC!D): ^ 
" *« Frequency Distribution . # : 



• 1* 

Pore entil« rzink 
. (aaon£ ali ' 
Minneapolio Public 

taking toot) 14 


Protest (September, 1973) 
N-852 otudonto taking toot 


Pootteet (May, 1974) 
H=725 otudento taking tost V 


w of ESAA. otudentef 
attaining thio 
rank 


t % of ESAA otudente 
attaining thio 
rank 


N of ESAA otudento 
attaining this 
rank 


% of ESAA otudento 
_attai.ni.ng this 
rank 


75-99 


1 


r *° 




1 ? \ 


70-74 


1 


) . 0 


2 


0 & 


65-69 


1 


0 




l' 


60*64 




0 


- I" » 


i 


•55-59 


? ( 


1 


13 


2 


50-54 




0 




• • ? 


45-49 


7 


- ■ 1 


21 


3 




18 




27 


4 


35-39 


22 


3 


46 


6 


30-34 


57 


7 


52 


7 


25-29 


103 


12 


48 


7 


20-24 


114 


, 13 , , ■ 


99 


14 


15-19 


120 




63 


9 


10-14 


171 




99 


14 


5-9 


124 




93 


. - 13 


0-4 


105 


12 ' 


104 


14 


DoGerifitive otatistico , 


Moatjfl 
Percontiio rank 


17.1 


22.4 


Standard deviation 
of poncontilo ranko 


11.6 © 


17.1 


Moan gain in . 
percentile rank 


5.5 ? • 


Standard deviation 
of mean gain? 5 


I6.I 



Note*— ESAA-oligible otudento from 2 of the 9 public echdoio (146 otudento in one ochool, 115 
in tho other) were omitted from thio analysis. Sane of these otudento had not used MBSOP materials 
and were therefore not participanto in tho ESAA Math Program. (Some uoed other programmed materials.) 
In theco two cchoolfr, ESAA otudonto (uoing MDSDP materials) were not clearly differentiated from 
non-ESAA otudonto. ) 



*Fhe Minneapolio Schools* Mathematics Dopartment Wxnputed coparato percentile norms for oach 
grade level (7th and 8th) and for oach toot administration (September and May). In constructing 
tho precent table, each ESAA student's raw score was referred to the appropriate percontile norms. 
Haw ccoreo of 9th grado ESAA students woro roforrod to 8th grade norms \ since no citywido 9th grado 
noma oxiot)# ■ \ 

b Gain in porcontilo rank wao calculated fbr tho 711 otudento taking both pretest and posttoot. 
Of thoco otudonto, 410 or 58# had a highor percentile rank in tho spring than in tho fall; 29 (4#) 
had the camo rank; and 272 (38#) had a lowor rank. One objective of the Math Component opecifiod 
that 5($ of the ESAA otudonto would have tho same or higher rank in the spring. Since 6&> of ESAA 
students maintained or improved thoir relative position among their peers, thio objective was met. 
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ESAA students ^n Schools F ond.G are reported in Tables 2, and 5. Students 
in these two schools were, hpwever, omitted from data analyses involving the 
total group of pure ESAA students and showing their success in meeting Com- ^ 
ponent objectives. * 
# * Number of students 'served by the Math Com Tpble ^ indicates 

,>that 1200 students wefre served bj the ESAA Math Component. The ^entries in ^ 
K various tables of the evaluations report * however, are based on fewer than 
; * . ■ 1200 students for the following reasons: (a) a number of ESAA students did 
.not take the MCT 'pretest, the posttest, or both; Table 2 shows that only 
? ~ 88? ESAA students (711 "pure ESAA 11 students plus ESAA students in Schools 

F and (0, took both protest and pocttoot. Cb) For 53 students participating 
in tho Math Component (usually for short periods) , neither MBSDP nor MACT 
data were available* (c) For a remaining 10 or so Imown ESAA students, 
MACT scores were available, but the evaluator dould not determine whethex* 
or not MBSDP units had been completed. J 
* In the ESAA public schools, the mean number of student^ served was 120 

per school, a figure which approximates the planned average of 125 school. 
Two schools, H and I, were markedly below expectation in the nt^ber of students 
served* In the 6 nonpublic schools, the mean number of students served was 
20 per school. 

Student demographic characteristics. In most schools, and for the ESAA 
students ad a total group, boys outnumbered girls (Table V shows 57$ vs. k% 
for the total group). * 

Approximately half the students were seventh graders. The distribution 
of students by grade level varied greatly from school to school. This 
variation was in part due to "two schools having no seventh grade in 197|^7^ 
and twa having no ninth grade. One of the ESAA Schools was a high school, 
and the ESAA students therefore only represented the ninth grade. In Schools 
B, G, and E t however , thdre is no ready explanation fo£ the lack of ninth 
grade participation in the ESAA Math Component K since all three^ schools had 
a ninth grade. Similarly, School D had an eighth grade, but no eighth-grade 
ESAA students. Apparently, since a teachers 1 participation in the ESAA* 
Math Component was voluntary, tho remedial-math teachers of tho omitted grade 
levels in Schools B,^C, D, and E decided not to use .the MBSDP math aides and 
MBSDP materials. 

^ Table k also indicates that for the total student group over half (5$#) 

w^ ; Whit0- Americans, "about one-third (3@0 were Black Americans, and less 
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than one in ten (7$) wore Indian Americans, Sponish-surnamed students, and 
students designated ft O#her n race or ethnic group constituted only 3# of the 

ESAA group. r " \ * 

For 'grades 7-9 in the city of Minneapolis as a whole, 83$ of the students 
during 1973-7^ were White, 12$ were Black, h% were Indian, $ were Spanish- 
'surnamed, and 3$ represented other racial categories. (Information on racial/ 
ethnic composition was obtained from the Pupil Personnel, Sight Count 1973-7^ 
prepared by £he Minneapolis Public Schools 1 Planning and Support Services 

Division, 1973i) v 

For the, junior-high grades in just the ESAA public schools, the relative 
frequencies of *the various minority groups were .generally higher than' the 
citywide relative* frequencies for the same grades. In ESAA sphools ifx 1973-7** , 
73$ of the, junior-high-levol students we*e white, 1$$ were Black, 6$ were 
Indian, 1$ were Spanish-surnamed, /and less than 1$ represented other minorities* 

In every ESAA public school except B and 0, the percentage of minority 
student a was higher for the Math Component than for grades 7-9 in the W^l 
student body. The percentage of minority students (glack, "Indian,. SpaMsh- ^ 
surnamod, and Asian American) in grades 7-9 in each ESAA school ranged from 
8% to kOfr (with tho exception of one junior high having a minority enrollment 
of 82$; this school was closed as a junior high at the end of tho 1973-7^ 
school year). The median minority enrollment among these schools was > 
approximately one-third. The ESAA math programs in four schools (A, D, H, 
and I) exceBded 50$ minority students, however. In School D, 52$ of the ESAA 
math students represented minorities, more than doubling the minority 
•enrollment of the school as a whole. In School E tho ESAA minority enrollment 
of 37$ waefover four-.and-one-half times tho school's 8$ minority enrollment. 

Table if shows that in Schools D" and" E a great majority (71$ and 91$, re- 
spectively) of tho ESAA students/rode the bus as port of the^Minneapolis 
Schools' desegregation plan. For other ESAA public schools, the proportion 
of ESAA math students riding tho bus was always loss than half. For all ESAA 
public-school math students taken' together , the proportion of bus riders was 
about one-third. 

The Staffing: and Daily Operation of tho Math\ Component 

Staffing .- Each of tho ESAA public junior highs received the equivalent 
of two full-time math aides, and nearly all nonpublic schools received one 
part-time math aide. Only St. Joan of Arc received no math aide (although 
the Math Component did provide MBSDP materials to this nonpublic school). The 
following public schools had two full-time aides: Anthony, Jefferson, Jordan, 
and Phillips. Lincoln and North each had one aide. Bryant and Franklin each 
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had three part-time aides; Ramsey had four part-time aides, A total of 25 
individuals served as aides in the Math Component, although some of t % hese 
aides worked part-time, * j • . 

The Math Gomponeifb funded the equivalent , of 16 full-time (seven hours 
payday ) math aides for public junior highs. In nonpijblitf schools the 
equivalent of four full^ime 1 "aides was funded. The money for nonpublic- 
schooll aid£Sj however, had to be' used to hire not/ only math aides, but also' 
t^ides r^r the ESM Reading Component. One nonpublic ^school ai^o, in fact, . 
^served bofcfe^ the Math and Reading Components. 

The Math Component also funded a 0.6-time Math Coordinator to serve as 
a resource. to all ESM schools (see p. l)^ 

As stated previously, the Math; Component did not fund any classroom 
teachers. The, ESM math aides worked under the supervision of existing . - 
classroom teachers. • A total of kk teachers in both public and nonpublic 
schools used ESM math aides and MBSDP material^ during 19?3~7*f. 

Apparently, the participation of classroenr teachers in the Math Component 
was voluntary in most schools. The number of math teachers using aides and 
materials ranged from two to five in the public schools. One or " two teachers 
in each nonpublic school participated. " The following public schools had 5 
participating teachers: Schools B, E, F, and G. Schools A and C had four 
teachers. Schools D and I had three teachers. School H had two. 

Appendix C is, a questionnaire on the ESM Math Component completed by 
^3 of the kk participating teachers. Appendix D is a questionnaire on % the 
role of the ESM math aide, which was completed by 24 of the 25 math aides. 
The responses of the teachers and aides have been tabulated on these sample 
questionnaires. 

Appendices C and D show that most of the staff persons employed in the 
Math Component were White American (91$ of "the A3 responding, teachers, 71$ of 
the Zh responding aides). Teachers tended to be male (6($) and aides tended 
strongly to be female (92$) • All of the minority aides' and teaohers were 
Black American* . 

Daily operation . The ESM I-iath Component depended for its implementation 
on the ?/oluntary acceptance of math aides and MBSDP materials by participating 
teachers of remedial math. ■ The part-time ESAA Math Coordinator provided 
consultation, not supervision, for the^teachere and aides. ^^Jfefe lL clas ses 



aided by ESM varied from school to^sepbol in (a) student^ccmposition, 
(b) the use of MBSDP materials, and (c) the role assigned by teachers to the 
ESM math aides. 

In most of the ESM schools, the officially designated ESM students and 

«» 

lB t * . a / s 

21) 



non-ESAA students worked side-by-side in the same remedial math classed. 

ESAA math aides- for these classes segve*°both ESAA' and non-ESAA students; 

> In §cme schools aided by TitJLe I, both ESAA math aides and. Title I math 

aides served the same students. Only in School D were "pure" ESAA math * 

classes constructed from the master list of ESAA 'students. School E, in 

contrast, had no ability grouping, and ESAA students were enrolled/in the 

same math classes with students -of higher achievement levels. 

The use of *MBSDP materials and the emphasis placed on thefce materials 

varied widely, from school to school, and even within thQ same schools While 

over 9 of every 10 teachers and over 9 of* 10 ESAA aides rkted the\lBSD^ 

materials as having at least ,r Moderate interest" f or ESM students (see 

Appendices C 'and D), nevertheless nearly all of the tpachertf used otheiv 

commercial materials in teaching the areas covered T5y the MBSDP curriculum* 

While most teachers and aides praised the interest level and instructional 

Value of the MBSDP units, ttfeir written comments suggested* that student 

interest waned with overreliance on any single teaching approach or math 

curriculum. Otl^fLr basic skills materials used by ESAA students included 

computer-generated materials (other than the whole number units listed in' 

Table 1), te:ctbooks, puzzles, and wooden bars to teach fractions concepts. 

In one ESAA school a participating teacher," as part of a Title I 

1 

project, developed units of materials covering many of the some areas as- 
the MBSDP. This teacher and others in the same school were understandably 
reluctant to replace their own indigeifous units with those of tho MBSDP. 

Problems in' the availability of MBSDP materials . Questionnaire comments 
by a number of participating teachers suggested that supplies of MBSDP 
materials were insufficient to serve their remedial students. A few teachers, 
of course, wanted materials $o serve more than -the 123 officially designated 
ESAA students. In a few schools, however, the 125 or so ESAA students 
wore inadequately supplied. Six teachers complained of delays in filling 
their MBSDP orders. Others werQ disappointed by lags in the publication 
of needed units (e.g., decimals). Some teachers resorted to machine dupli* 
cation of a units in short supply. Port of the responsibility for materials 
shortages probably rests with those teachers v/ho failed to place timely 
orders with the ESAA administration. 4 • 

fflya enacted role of the'ihath aides . Teachers participating in tho 
Math Component deployed aides in one of tv/o ways. Some (e.g., in Schools 
E, F, and G) sent students individually or in small groups to work with aidps 
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t in- separate offices outside th^'clapeypcm^Teachers in other schpols (o.g.i 
• i), H| DAd I) generally vjorkeSj^^^^i^B^iQ with aides in the classroom . iAmong 
\^ •» a email sample 'of aides personally qttfe£tiofte&.by the evaluatqr., . all preferred 



to wo£k within the classroom. 



A 



The following description" of thG 'math aides 1 work in the schools is bprfed 
on the aides '* responses to the questionnaire concerning their enact&ekrol.e 
(see Appendix D). For each of 10 activities, aides wdre ael;6d (a) whether 

thoy performed the activity; '(b) how they performed the activity (including 

& b y. - 4 ' * 

any "tips 11 they woulcl suggest to others wanting to help ESAA students master 

mathematics) - ; and (c) the percent of tatal «fcira£ they«fspQnt on tjtie activity . e 

The following picture of the math* aide 1 a role emerged* . i 

Approximately 60$ .cf the aides 1 #imo was'spent in four activities which* 

involved direct .interaction with studsats. The aides \§iAgI© most time*? 

consuming activity was "helping individual students to do their work," which 

. <i . . / 

occupied 25 minutes of every classroom hour, cn'the averago, ' Similar activities 

included^'helping small groups of 'students to dot their work" (8 minutes per 
hour, on the average) and "giving feedback to students concerning their class- 
room performance" (2 minutes). Commenting on these activities, seven aide0 
felt that # ESAA students thrive on pationqe, encouragement, and individual 
attention. According to four aides, giving positive feedback is an important 
part of the aide's job, ("even when I'm busy," said one aide). A few aides 
found time to "rap" with\students about personal problems or jijst to get 
acquainted with students. 

Various clerical tasks, including record-keeping, Gccu^e4 approximately 
h(£o of the aides 1 time. These activities included (a) scoring % tests and other 
written materials (6 minutes of every hour, on the average); (b) Maintaining 
student records concerning MBSDP progress,' MACSj^ scores,* grades, and attendance 
(4 minutes); (e) passing out and monitoring tests (2 minutes); (d) selecting,, 
finding, pr writing materials to supplement the MBSDP materials (2 minutes); . 
and (e) duplicating tests, KBSDP units, and; other written* materials • 

Other infrequent activities included participation in parent-teacher 
conference*, typing J housekeeping, and assisting the teacher with grading • 
Qne aide inappropriately spent some time helping students who forgot their 
c combinations. 1 
Apparently, the math aides generally Sfi joyed good working relationships, 
with their supervising teachers. Approximately half of the aides and half 
of the teachers rated the aide-teacher relationship" ao "Excellent." Only 
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two teachers (and no aides) rated the .relationship, "Poor. 11 (See, the six- - 
point scale in Appendices C and D). 

In School G, notable exceptions Occurred to this pattern of generally 
good working relationships. The ESAA aides in School G were located in an 
.office outside the classrooms. The teachers, however, sent very few studexits to. 
these aides. One teacher tended to send students; who were disruptive rather than 
remedial. The two aides formally approached each teacher of ESAA- students, after 
making a master list of each ESAA student's math teacher, claes time, and room 
location. The aides offered to take ESAA students for tutoring and work ORr4G5SD]T 
material^. little Increase *in referrals occurred, ^Jioweyer f leading dneaide to s 

"I. sometimes feel some teachers don'i really support the. concept of this program. 

■ • .-»... ' . • „ ■" * ' 

THE EFFECTIVENESS OF THE MATH COMPONENT 
IN MEETING ITS OBJECTIVES 

The Math Component not only met, but surpassed, its two, goals for gains 
. in mathematics mastery among the lowest-achieving*, junior-high math students 
in Minneapolis schools. 

The first part .of this section concerns the attainment of the two main 
program objectives. The second patft dispusses some differences among: the 
ESAA math programs in the ESAA public schools plausibly accounting for the 
observed differences, in their math-skill gain rates. 

^pbjective I . Tables 2 and 3 show that 629b. of the evaluation-eligible 
ESAA students who took both the fall and spring MACT had a percentile rank 
in May, i$>7^i which was the same as, or higher than, their percentile rank 
in September, 1973« Objective I was therefore met, since it required only* 
5($ of ESAA students to maintain or improve their relative position among 
their peers. e . / m 

Objective I was not only met among the total group of "pure ESAA 11 
students, but also within seven of nine public schools and the combined 
six nonpublic schools. The median school gain (counting the nonpublic 
group as one "school 11 ) was 5.5* 'tfhese school means ranged from -^ percen- 
tile points of "gain" (for School I) to l*f points (for School D). 

Objective II . Attainment of Objective II required that 5C# of the 
evaluation-eligible ESAA students earn Mastery-Gain Points on MBSDP units 
at the rate of 4-0 or more pe,r year (10 or more points per quarter). Table 
5 shows that in fact two -thirds of the total group of 4'pure ESAA 11 students 
met this objective. 
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As with Objective I, the great majority of individual ESAA schools, as 
well as the total student group ,^met Ob jectivl II. In eight of nine public , 
^schools (including "non-pure" Schools F and G) and in the combined nonpublic 
schools, ESAA students earned Mastery^Gain Points at the rate of 10 or more 
Points per quarter*. The faedian sdhdol gt&fr was X$.h Points per quarter. 
The range of school means was frpm jS.O Points per'qu^tfer (for School B) 
to 26.9 Points (School I). . , - • # " 

Table 5 also shows that in every school- except Behalf or more of the 
ESAA students met Objective II. Schools with the highest, percent of ESAA 
students meeting Objective II were A, D, and F, where approximately 9 of * 
every 10 students earned 10 or more points per quarter. Seizor B had the 
lowest percent (l6#) of students meeting Objective II, a rate less than 
one-fourth that of any other ESAA public School ^ 
The Ambiguous Meaning of MACT Gains * , , 

Objective I, pertaining to MACT gains, was clearly met. As specified 
in the formal statement of the objective, 62# of "pure ESAA" students main- 
tained or improved their relative MACT standing among their Minneapolis 
grade-*level peers. Table 3 shows a mean gain in percentile rank of 5.5 for 
those 711 "pure ESAA" students taking both the pretest and posttest. 

Because of the method used to select ESAA students, ••however-*- that of 
choosing for the Math Component the lowest-scoring students on the fall 
MACT — one cannot determine whether this mean gain of 5^.5 percentile points 
represents a real improvement in these students 1 relative standing in math 
basic skills or an artifactusuU gain attributable to pretest-to-posttest 
regression. 

Whenever a group is selected for the extremity of its scores on a 
test, thfitt^fifie same group would be expected to have less extreme scores, 
on the average, on a second equivalent test, even if no educational treatment 
intervened between the two tests. This "regression artifact, M described by 
a number of statisticians including Campbell and Stanley (1963, pp. 10-12), 
is possible for all tests that have an imperfect (less than 1.0) test-retest 
correlation. This statistical phenomenon is expected whenever groups are 

A preteat and posttest are imperfectly correlated whenever a student's 
posttest score is not completely predictable from that student's pretest t 
score. Students with the same pretest score may obtain different posttest 
scores for many reasons. For example, students may learn diffel^nt amounts, 
or, on a particular day and a particular test, they may show differences in 
effort, experience differences in fatigue, or have differences in fl luck, fl 
All of these factors except actual learning contribute to both error oij 
measurement and an imperfect^ test-retest correlation. 
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chosen because they lie at the extremes of a score distribution (i.e. , they 
have wctreraely low scores or extremely- high scores). 

•\'|^t-'the case ^pf M&CT scores, one might .imagine choosing two groups: 
students with extremely low MACT scores (e.g* , 'ESAA students) and students 
Vith extremely high scores. Even if no Math Component were administered and 
no real change in math ability occi&red, s>ne 'would expect that on any post- 
test' MACT (e.g. , after a short period), the extremely low pretest scorers 
would generally make higher raw scores and percentiles* and the extremely 
high pretest scorers would, on the average/ have poorer posttest scores tod 
percentiles. Except for the knowledge that no instructional program took 
place (in this fictitious example ) f f one might erroneously .conclude that the m 
poorest students were getting better and the best students were getting poorer 

* In short, the finding that ESAA students in general improved their HkCT 
percentile rank -from fall to spring is not surprising. Nox* is the degree of 
gain a firm estimate of the degree to which ESAA students in $973-7**- improved 
tfieir "true 11 math ekille relative to their seme-grade peerfl. 

' The size of the percentile gain attributable to the regression artifact 
will be roughly estimated in the following discussion: 

According to the frequency distributions of 1973-?** MACT scores (Appendix 
A), the mean September raw score for all Minneapolis seventh graders was 
12.9; for al^ eighth graders*- the mean pretest raw score was 17-3- For^all 
"pure ESAA" students the mean pretest raw score was 6.5- 

Although information on the psychometric characteristics of the MACT 
* is not available, let one assume that any two forms of the MACT have equal 
means, equal variances, normal distributions of scores, and test-retest 
correlations in the respectable neighborhood of .80. Then the posttest 
MACT scores of ESAA students (selected only on the basis of a low pretest 
score) should, on the average, be 20$ closer to the mean than the same 
students 1 pretest scores, even if no schooling intervened between pretest 
and posttest. This statistical regression of 20$ toward the mean follows, 
'directly from the assumption that the test-revest correlation is .80. 

Schooling did, of <jourse, intervene between fall and Spring admin- 
istrations of the MACT. Minneapolis seventh graders, on the average, had- 
6.7 more correct .answers on the posttest than on the pretest. .Remedial f 
seventh graders who scored near the ESAA mean of 6.5 points on the* pretest, 
however, needed to get only about 5 more problems correct on the posttest 
to maintain their percentile rank among all seventh graders of about 23. m 

Minneapolis eighth graders, on the average, improved their pretest 
MOT performance/by 4.7 raw-score points. Remedial students with pretest. 
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answering near 6.5 on the pretest needed between k and 5* additional correct 
answers to maintain their percentile rank among all eighth graders of about 12. 

The average ESAA student answered slightly over 6 more problems correct 
on the posttest than on the pretest. The question is, How much of thisr 0 
6.2 point gain is attributable to regression and how much is due to real 
gain in math skills? 

. . . , ^ 

^If both ESAA seventh graders and ESAA eighth graders had the same 
average pretest raw score of 6.5, then ESAA seventh graders were 6.*f points . 
belo$ the Minneapolis seventh grade mean, and ESAA eighth graders, were 10*8 
points below the Minneapolis eighth grade mean. One could therefore estimate 

* that the pretest-to-posttest gain due to regression is about 1 raw-score^ . 
points for seventh graders juad about 2 points for eighth graders. 

Subtracting the &$irmte& gain due to regression, the corrected mean 
raw gain for ESAA seventh graders was approximately 5 correct answers and 
the corrected mean gain for ESAA eighth graders was about *f points. ■ 

. Although the Math Component met Objective I as stated in the proposal, 
with 62$ of ESAA -students maintaining or improving their relative standing 

* on the MACT, the above discussion suggests that the "true" gains in mastery 
of MACT^type math problems were probably the same for ESAA students and 
for other remedial math students in Minneapolis having the same fall, 1973t 
grade placement and pretest scorea. If the above reasoning is correct i 
probably about 50$ of the total gr^up of "pure ESAA n students, not 6295, 

* actually improved their standing among peers in skills measured by the MACT. 
Differences Among Schools in the Math Gains of Their ESAA Studenttg ^^^^ c ^ 

As discussed above, every school surpassed at least one of (the mastery- 
gain rates specified by the two program objectives; 'most schools exceeded 

both objectives. Since differences iij. mastery gain did emerge among the 

i / 

schools, however, this section of the report explores some factors plausi^y 
accounting for a school's greater or lesser success in meeting program 
objectives. ' • 

The relationship between mastery gains as measured by the MACT and gains 
measured by progress on MBSDP units . First, for individual students it appears 
that progress on MBSDP units was only moderately related to MACT gain. For 
those 711 pure ESAA students with complete data, the correlation between total 
Mastery-Gain Points earned and raw MACT gain Was .30 , /accounting for less than 
10$ of the variance in either set of scores. This modest correlation between • 
MBSDP progress and MACT gain is not surprising, and indicates that students' 
completion of MBSDP units is neither a necessary nor sufficient condition for 
MACT gain. 2 ^ 



For schools, however, the correlation between MBSDP progress and MACT 
gain was greater than thevcayretsponding correlation for individual students. 
When the performance of all feSAA students at a given pure-JCSAA school (except 
I) was combined, the v mean number of MBSDP points earned correlated .56 with 
that school's mean MACT gain. Since this correlation is' based on only 6 
'pairs of means, it is not reliably different from zero at the % significance 
level. If this correlation proves stable, it would indicate that a student's 
sub^tarit^Lal progress or MBSDP units is most predictive of high MACT gains in 
schools where that stud^n^'fi ESAA peers also earn a relatively high number 
of MBSDP points. 

Higher-gain and lower-gain schools. . The school means on MBSDP progress 
and MACT gain were studied to select ESAA scshoals more and less successful 
in meeting Math Component objectives. Schools D f E, and F were above, the 
median of aliLEj&A public schools in both MBSDP progress arid MACT gain; 
these three schools are called "higher-gain schools." Schools B, C, and 
G fell he&ow the median on both indices of mastery gain and are called "lower- 
gain schools." The terms "higher«gain" and "lower-gain" do not, of course, 
imply absolute judgments and are relative only to differences between the / 
public schools invo!ved^ in the ESAA Math Component. 

-■m- Characteristics of higher-gain and lower-gain schools . Differences 
between the Math Components in the higher-gain and lower-gain schools were 
sought, to plausibly account for their differences in math-mastery gain. 
A nAber of potentially relevant differences were explored and discarded as 
important Correlates of mastery differences between these schools. The ^ 
school's wean pretest MACT score, the percent of boys^vs. girls in the ESAA 
Math Component, and the number of «tu<tents servecl were among the variables^ 
that failed to differentiate fyigher-f rom lower-gain schools. The following 
differences between higher-and lower-gain schools * seemingly relevant to 
mastery gain, were noted: ^ 

1. In the higher-gain schools, the teachers and aides in the ESAA math 
program seemed better organized than the ESAA teachers and aides in the lower- 
gain schools. In School D a strong leader emerged among the three participating 
ESAA math teachers. This teacher coordinated the scheduling of remedial math 
classes, the work of the ESAA math aides, and the ordering of MBSDP materials. 
Each participating teacher taught two classes consisting entirel^ of ninth- 
grade ESAA students. The teachers and-aidps all used the same large room for* 
'lesson planning, clerical work, and disoussion of common instructional problems r 

^School I was omitted because the MACT gain mean was based on only 21 of the 
75 students participating in the program. 
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The* fact that ESAA students in School B were all ninth graders c aiuiot - 
solely account for the high gaiss of these students; in School E f for 
example, 9 of every 10 students were seventh graders, and yet School E was 
also a higher-gain school.' Ifc School B, as in School D, the teachers of ■ 
ESAA students and/ the aides alfio shared a common preparation room. The 
evaCl^tor's observations suggested that ESAA math teachers in the higher- 1 
gain schools communicated with each other more frequently than teachers in 
the lower-gain schools: sudh discussion probably made possible mutual 
help in the difficult task of teaching remedial students. *■ ( 

£. The ESAA teatshers in the higher-gain schools seemed to haye more 
genuine enthusiasm for the teaching of remedial math than teachers 3# the 
lower-gain schools. In School D, for example, the teacher who emerged as 
the unofficial leader of the ESAA program was eager for the evaluator to 
observe her ESAA classes, j^oal F had actively sought funds and staff to 
improve its remedial programs. One teacher in School F was, a specialist in 
remedial math who had developed his own basic skills materials as part of a ? 
Title I project. / 

^ 3. Teachers in the higher-gain schools were mpre favorable toward MBSDP 
materials than teachers in the lowerrgain schools. The teachers in higher 
gain schools generally \rated the, MBSDP materials as having "High interest" % 
for ESAA students, while teachers in lower-gain schools-rated the materials 
slightly lower, as having between "Moderate" and "High" interest (see question 
in Appendix C ) . 

In their responses to the ESAA teacher questionnaire, 3 of the 13 
teachers in higher-gain schools spontaneously expressed a desire for more 
MBSDg^daterials, so they could serve more than 125 remedial students in their 
schools. None of the .teachers in lpwer-gain schools expressed such a desire. 

*f. The ESAA math aides' were used more efficiently, and granted more re- 
sponsibility, in the higher-gain schools than in the lower-gain schools. In 
Schools D and F the aides were respected by teachers as valued colleagues in 
the classroom. For example, the "lead" teacher in School D introduced each 
aide to the evaluator as an important member of the instructional" team. In 
School D aides worked side-by-side with teacherfe, and aide morale seemed 
extremely high. In School F the ESAA math teachers also showed considerable 
respect for aides, sending students in small groups to the aides for reme* 
diation of specific weaknesses. 

In lower-^l^ School G, as described above, the aides were relatively 
isolated f r<?m both teachers and students. Aide morale was low when 
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the ©valuator visited. School G in May 1974. One teacher in School G 
volunteered the judgment that ESAA math aides had not been used effec- 
tively. ■ 

KECOMKENDATIONS • - ' '•: 
Recommendations regarding the improvement and re-funding of this^ • 
program may be academic , since the decision has already been made t?K^is- 
continue funding for the ESAA Mdth , Component. The ev&luator nevertheless 
offers the following suggestions, in the hope that they will bo useful to 
those who plan and seek funding for -future programs of this type. 
Recommendations for the Improvement of Math Component Operation 

A more efficient system of ordering and delivering materials should 
be instituted . Several teachers and aides complained of inadequate supplies 
of MBSDP materials and delays in receiving ordered materials. 
Sufficient quantities of all MBSDP units (one copy of the most commonly 
used units for each ESAA student in each school; fewer copies of less 
frequently used or "optional 11 units) should be ordered by the ESAA admin- 
istration before the start of the school year. These, materials should ttjon 
be stored in a central ESAA math-materials depository. A memo from on ESAA 
math teacher to the ESAA Math Coordinator should be sufficient to release 
the needed materials to the school. The materials, already allotted to the 
school and in storage, could arrive in the classroom within one or two days 
of the order. ' 

2. As a prerequisite for a school's participation in the Math Component , 
* a group of remedial math teachers in the school should formally commit them- 
selves to the use of ESAA math aides , the use of MBSDP materials, and the 
Scheduling of regular meetings of ESAA math aides and teachers during the 
schpol year . Since the Math Component fun#s no teachers, and since aides 

do not have authority for instruction within the school, some organization 
of ESAA staff within the school seems necessary to insure that the Math 
Component will be carried out according to basic plan« 

3. A full-time ESAA Math Coordinator is%eeded to supervise the delivery 
of MBSPP materials (Recommendation l) and the maintenance of adequate Math- 
Component organisation within each school (Recommendation 2) * 




'f. The ESAA Project Staff should carefully consider the fact that 
. students of racial minorities were overreprosented in the ESAA math programs 
of some schools (see pp. 15-17) . Educational need should be synthesized with 
the need for racial, balance so that unintendedS^eilsgregation does not. occur. 
..' . 5. The participating teachers' should more carefully screen incoming 
- ESAA students to insure that students selected are those for whom the 
Math Component is intended. Although the great majority of 1973-7^ ESAA 
students were well suited to the program, 7# of the students were above 
the thirty-fifth percentile on the MACT pretest. Such students ^do not seem 
markedly below their peers in math achievement. 

- •< 

6. As in the past t minority .persons should be encouraged to apply for 
positions as math aides. Some slight improvement in recruitment of raoial 
minorities seems warranted. Among ESAA students, "0> were Black American 
and 7*5 were Indian American. Among ESAA math aides,^2^ were Black American 
-and none were Indian American. 

7. The specification of Math Component objectives in terms of MAPI gain t 
scores is inappropriate and misleading, in view of the regression artifact 
that inevitably increases the pretest to posttest gains of students selected 
for their low pretest scores. The evaluator jsuggests that in the future, if 
MACT gain scores if ESAA students are used to assess program effectiveness, 
that: (a) a control-group design be used, pitting the gains of ESAA students 
against those of remedial student In nen-BSAA, schools L»imilarly selected 

for low test scores; (b) on attempt be made to estimpe probable gains due 
to regression and adjust the statement of the objoetive accordingly; and/or 
(c) soma, attempt bo made to computo a "rogression-freei" "residual," or 
"corrected" gaian score, using methods suggested by Gronbaoh and Purby (1969). 
Hocommondatioa for the He-Funding of tho Math"' Component. 

The evokuator believes continued funding should bo sought for the Math 
Component, provided recommended program Improvements are made. Overall, and 
in most ESAA schools, Math Component has met^s critically important objec- 
tives of improving math basic skills among the lowest achieving junior high 
students in Minneapolis* 

Despite some flaws, in organisation and implementation, tho Math Component 
provided high-interest materials and individual tutoring by aides for large 
numbers of remedial students. In meiy of tho ESAA schools, the provision of 
aides and materials filled two important, recognized netds of a compensatory 
math program— and filled those noeds at relatively low cost. 

a 

29 
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Appendix A 



Minneapolis Public School 
Department of M'athematips 

MINNEAPOLIS ARITHMETIC COMPUTATION TEST 
SUMMARY OF RESULTS , 
GRADE 7--1973-7U 



Frequency Distribution 




FALL 



SPRING 



Frequency 



Cumulative 
Frequency 



Cumulative 
Per Cent 



Frequency 



Cumulative 
Frequency 



Cumulative 
Per Cent 



3 

1U 
16 

23 



U0l*3 

1*026. 
UOIO 



100.0 
99.9 
99.6 
99.2 



8<? 

123 
16? 
172 



3813 
3721* 
3601 
3U3U 



100.0 
97.7 
9l*.l* 
90.1 



29 
28 
27 
26 

21 



30 
32 
1*1 

70 

59 



3987 
3957 
3925 
388U 
3f8lU 



98.6 
97.9 
97.1 
96.1 
9l*.3 



151* 
171 
12U 
152 
163 



3262 
3108 
2937 
2813 
2661 



85.5 
81.5 
77.0 
73 ;8 
69.8 



2k 
23 
22 
21 
20 



18 
17 
16 * 

15 



13 
12 
11 
10 



9 




75 
92 
99 
131* 
10$ 



126 
158 
128^ 
16U 
177 



19T 
179 
191 

208 
208 



218 
239 
238 
218 
186 



127 
135 
83 
53 
18 



3755 
3680 
3588 
31*89 
M 
32h6 
3120 
2962 
2831* 
2670 



92.9 
91.0 
88.7 
86.3 
83.0 



80.3 
.77.2 
73.3 
70.1 
66.0 



1BT 
2301 
2122 
1931 
1723 



"5l7f 
56.9 
52:5 
1*7.8 
U2.6 



15L5 
1297 

1058 
820 
ip2 

m 

289 
15U 
71 
18 



37.5 
32.1 
26.2 
20.3 
lit.9 



10.3 
7.1 
3.8 
1.8 
.1* 



152 
118 
11*3 
139 
159 



2^98 
231*6 
2228 

2085 
191*6 



131 
115 
129 
138 
123 
1ST 
106 
130 
130 
1'03 



1787 
1656 
-151*1 

lUlt 
127^ 



1T5T 
102U 
918 

788 
658 



115 

97 
93 
82 
6h 



555 
14*0 

M 
250 
168 



38 
31* 
19 
7 
6 



101* 

32" 

13 
6 



65.5 
61.5 
58 

51*.7 
51.0 



1*6.9 
1*3.1* 
1*0.1* 
37.0 
33.1* 



"30TS" 

26.9 
2U.1 
20.7 
17.3 



li*.6 

11.5 
9.0 
6.6 
h.h 



2.7 
1.7 
.8 

.3 
.2 



EH til 
6/19/71* 
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Appdndix A (continued) 

Minneapolis Public Schools 
Department of Mathematics 



MINNEAPOLIS ARITHMETIC COMPUTATION TEST 
SUMMARY OP RESULTS 
GRADE 8--1973-7U 

Frequency Distribution 




BH:il • 
6/19/1U 
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Form 2K 
Sard 1 



Appendi* B 

Hinnaapolia Public Schoola 
Student In format ion Form 
for ESAA Hath Program 



z 

T 



Student's code numDcr 
(do not fill in.) 



C8) Student' o grmd© placement during 1973-7**. Check one: 
7th grade 

. 8th grade f ■ 

ZZZZ 9tn Rrade: " -Si 

-1 Other* pleaae opacify* 

- — — * \^ _ ■ 



(9) Student* p nex: * 

- 1 Male 
______ ? .Female * 

(10) Student* a mce or ethnic group. Chock on*»: 

A ; 1 White American 

_V 2 Black American 

• " ? Indian American 

'i .Span i£h~*ur named American 

*> Aflan American** 

6 Crher, Ploaae opacify: ... 



(11) Did thia etiident ride a bua to cehool as part of the 
Minnoapolir Public Schoolc* desegregation plan? Check 
, »v*£ M or "Wo** union* thio Ira nonpublic nehdol. If 
a nonpublic school, chock Blank % 

1 Ua 

' ! 2 No 

~ j Thio io a nonpublic ochool 
(ID What type of grading period* (narking poricda) doe* 
thin cchool have? Check one: ^ 

J 3 Trimester* 
„ ; h Quarters * 



Plcane check below all 197V? 1 * grading periods (quarter* or 
trinenter*) during which thio ntudont wao a twl U na w a ll y on~ 
rolled, in Hue r.chool, in n math clan* with an B/lAA aide 
u and mm material*. (Note; ignore tho otudent** attendance 
[ rTTTord. Junt cheek period* ho/*he wa« "on the ro)^o. ) 
;:heck blank* (n) in Uio left column if you ere qr* tho tri- 
meater oyatcm or (h) in *Ihe right column, U on the quarter 
*yp*.cm« 



dpn't 
keypunch 



a. Trimcr.toro 
In 1075-7'* 



b. Quartern 
in 1973-7'* 



1 M During the overall total of all 1973-7'* grading period* 
" you Juufc cheSTciT; did Ene nludent attend hnU (W) or 
more of Hie tfliAA math claim amnion*? 




Contact person: 

Paul HiAjina, Project ^valuator 
Tel. ,WW6l**2-or 6i*K> 
Minneapolis Public School* 
807 R» £* Brondway 
Kinneapolio, HN 55^*13 



Student' a acoraa on the HACT (Minneapolis Arithmetic 
Computation Teat). " ] "™ ~™ 

Fall. 1973 



(l<h-15> 
(16-17) 



b. Spring, 197j* 
(18-19) 

(2o-a) 



flaw ncore 

•# 

Percentile rank in relation to all 
Minneapolis student* at the *nme 
grade-level , taking it rX at the *ome 
time* 



Raw ccoro 
Po/centile rank 



c. Subtract fall, 197% raw ncore from spring, V<?h t 
raw ncore • 



(22-2** 









^Writrf* in * 


or ~ 



kaw ncore difference 



percentile rnnks 



(25-27) 



Percentile rank d$i {Terence 



\Writc in 4 or 3 ' 
Student** 1973-7 1 * progroa* on MBSDP uni tJCjfljo%fcher eidcJ: 

I T I "| Total nurabor of MnSfery Gain 

(?8~30) | Point* earned (from other *ide t 

colnmna fi'i-^V) 



(3D 



< 22-3*0 



(35-37) 



(38-39) 



ing 



□ Total , number of 197^-7'* gradir 
period* /ti»J«'rii wn/ enrolled 
ItytnrUwt' or triniM t<»r< j ree chart 
on Hill* P*r! c t ''° l«*f t )• 



.□ 



Divide total point,* in (?«-30> 
by total grading, period* In . 
(31) and round to nf»orc*t 
tenth. 



(Do not fill in) 



('♦0-79 ) Ulank 
({JoJ UCard number 



for what percent of hir./hcr total 
math elan* timo In T//V7'» did thi<* 
ntudent work on MIUiDl' material*? 
(Uound to nearest 



a 



4u 



Card a* 



Appe&ditf B (continued) 



Page' ? 



Cl-7) 



Please firU.in 



12 



colugoa 1-7 on Pege ljr 

(Student 1 a code nueber* 



Student 'a 1973-7* gflgggg 
Progreeo is 5eou£f3 In 



below and fill in, the needed information,, 



ota Mathematics Baaio Skllla Pevtlojitnt Project (HB£PP) pita, b 
aatery Gain Points" earned in this school. Pleaod rood tho chart 



HBSDP 
tfeit 

(in parenthoois, 
nuaber of probleu 
on each pretest 

frnd poattect ) 



Student' a Haetery Oain Pointe 



Preteat 

•core 

(ntaiber 

correct) 



Cqnrereion table; 
For each unit, find 
pretest ^core on top 
line, assign Gala 

Points frow bottow 
line 

T 



If poettest 
passed, 

Haatery 

Gain Points 
earned 




HBSDP 
Unit * 

(in parenthesis | 
number of problems 
on each protect 
and posttect ) 



Student 1 r Mar;tory Oain Pointo 



Pretest 
score 
(number 
correct ) 



Conversion table 
For each unit, find 

protect ccorc on top 
line, acsign Cain 
Pointn from l/otton 
^lino 



Tf poof>tc|fr 
paeeed, ♦ 
Kaxtory 
Uafri Foin** 
darned 



•If student took specie! 10-ite??i t^oto and unite for 
these aath topica, tho pretest- cutting pointa are 0-3t 
V6, 7-8# Th<i corresponding fisin Scot** cutting pointo er* K (68-79) Hlantt 
O M-nn for tho MBSDP units. 9? ' <&» P^Card nunbnr 

ERIC . .41 



Total (on tor on other nido, cqJunmo Pfl-Jfi) 



3M 
Form 3M 



>p|^ndix C . 

Minneapolis Public Schools 
BgAA Math Teacher Form 



Cover Page 



Your jfjame; 
Your school: 



Instructions : V \ 

•' # ■ ■ • « • • 

Please answer the questions' on the following pages. Your answers 
will be used (a) to describe how the ESAA Project, actually operates, 
Ob) to estimate the Project's effectiveness in meeting objectives, and 
(c) to make recommendations "for improving the Project. 

Your answers are anonymous* The following code number will be 
used instead of your name to identify your answers; 



This code, known only to the evaluator, will be used to compare 
the answers of all ESAA people at the same school . Names of individuals 
will not appear in an^reportsj and your answers will not be identified 
to anyone connected with yojir employment. 

I do need this cover o page with *your name (a) tb determine who has 
and has not answered the questionnaire and (b) to conduct any needed 
follow-up. ' . . : j... \ 

Do you have any questions? 

Now, please remove this cover page and pass it in. 



42 : 

36 



4' 

. v 



M=Mean - («ivera^e ) 
S # D,=StaridaJrd deviation 
Ton 3H NR=Wo response 



Appendix C (continued) 

Minneapolis Public Schools 
ESAA Math-Teacher Form 



Contact person : 

Paul Higgine t Project ^valuator 
Tel. 3*fS-6lte or 6lk0 
Minneapolis Public Schools 
807 N. £• Broadway 
Minneapolis, MN 55*H3 



Introductory rem a r kg to teacher 1 'I. have been employed by the Minneapolis Public 
Schoojs to help conduct the federa^Jy required evaluation of the ESAA Project. 
I would like to discuss with you frankly the operation of the ESAA Math Components 

I would also appreciate ^rour suggestions for improvement of the ESAA Math Component. Name? of individuals 
will not appear in any reports, and your answers will not be identified to anyone connected with your employment 



do not fill in 



(1*7) 



3 O Z 



Teacher's cods number 



(8) >Sex 
26 



1 Male ( 

2 Female 



6<# 



9& 
2% 



2 NR 

(9>) Hace or ethnic groups 
I.White American 
1 P. Black American 
V 0 ^ Indian American v 0$ 

0 k ttpanish-surnamod American 

1 5 Asian American 

, O 6 Other. Please specify: 



2 NR 



(10-11) 



-J I I How many different math classes did 
[ I 1 you teach in 1973-7^ that contained 



ESAA students? 

S.D.=, +1.5 



(12) Did all the ESAA students in your math classes use 
MBSDP materials? 



-21 



8 



lYes 8l# 
?. No 19^ 



If your answer was t! No f M please explain why MBSDP 
materials were not used: 



(1>) How much interest did the ISAA students show toward 
the MBSDP materials? Check one: 

2 7 Extremely high interest 



19; 



6 Very high interest 
S High interest « 
h Moderate interest 
1 3 Slight interest 

0 2 Very alight interest 

1 1 No interest at all 

Do yoji have any comnents, criticisms, or suggestions 
concerning the MBSDP materials (Units and Testa)? 

1 m « . 2% 



1296 

W> 
2% 

2# 



o 

ERIC 



(l**) Did you have enough MBSDP materials (Units and 
Tests) for all of your ESAA students? 



10 



1 Yes 

2 No 



72^ 
2% 



Describe any insufficiencies in your supply of 
MBSDP materials: 



2 MR 



How were the MBSDP materials used with KSAA students? 

(15) How oftenl were, the material;* used? ('hack one: 

, 16 5 Onco a day y$> 

19 Between 2 and k times per week M#£ 
P 3 About once a week 

1 2 About once every two w 

.. »*< * 

2 1 Less often than once every two weeks 

% ; 



0 Never 



When MBSDP Units were assigned, were the assignments 
made to: 

(16) Students as individuals? 

56" 1 Yes 8k% 
3 2 No 7% 

, \ VNR <# 

(17) Students in small groups? 

7 1 Yes 1(&> 
'20 2 No k$£ fc 

<l8) Whale classes Sconce? - 
3A 1 Yes 3# 

17 2 No kO)(> * , 



Please gl^e'any suggestions or "tips" you would make for 
the effective use of MBSDP materials with ESAA students: 



(19) Do you use other materials, besides MBSDP materials, 
in teaching the areas of math basic skills? 

ho 1 Yes 

3 2 No 7t> 

If "Yes," please describe the materials and the 
students* reactions: 



43 
37 



FormrjM 



Appendix . G (continued) 



Page 2 



(20) DM you participate in any prs-service or in-service 
'.."V training program designed to help you use the MBSDP J\ 
materials? 



1 Yes 
? No 



79# 
12$ 



(23) Do you know of any ESAA-eligible student(s) in 
your school who wore not enrolled ih^a math class 
with an ESAA Math AidTand MBSDP materials? 



Please doncribe any such training program: 



tfi 1 Yes 

2L * no 



37* 
h9& 



If you answered "Yes/ 1 please givr* the mimber of 
such Students and explain their lack of participa- 
tion in the ESAA Math Component : 

' 6 NR * lk% 



(21) tf you answered °Yes M to (20), please rate the* 
training program's effectiveness in preparing , 
you to use the >1BSDP materials* 



21 



SL 



6 Excellent 
5 Very good 
k Good 
3^ Fair 
2 Poor 
1 Very poor 



1$ 

($ 



Please describe your criticisms of the training 
and/or suggest improvements in the training: 

8 NR ' 19^ 



(2*0 Do you think the ESAA Math Component— which in- 
cludes Math Aides and MBSDP materials-should he 
changed in any way next year in your school? 



17 



1 Yes *f($ 

2 No 33^ 
8 '\ 3 Uncertain 3-9$ 



14 



If you answered "Yes" or "Uncertain/* please 
explain; 



k NR 




(22^ How would you describe your working relationship 
with the ESAA Math Teacher-Aide (s) who assist you? 

■„ 6 Excellent 

12 5 V«ry good 28$ 

5 A (Joe's 12# 

1 3 Fair 2$ 

2 • _P Poor % 

Q 1 Very poor &/o 

If you feel the relationship(s) could be improved, 
deftcrihf» how improvement might be made: 

' 5 NR ...... 7^ 



(25-79) Blank 
(.80) 1 -Card number 



ERIC 
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. Cover Page 



Appendix D 



Minneapolis Public Schools 
ESftA Hath Aide Form 



Your name : 
Your school: 



Instruction©: 



Please answer the questions on the following pages. Your answers 
will be used (a) to describe how the ESAA Project actually operates, 

(b) to estimate the Project's effectiveness in meeting objectives, and 

(c) to make recommendations for improving the Project. 

Your answers are anonymous. The following code number will be 
used instead of your name to identify your answers: 



This code, known only to the evaluatori will be used to compare 
the answer© of all ESM people at the same school* Names of individuals 
will not appear in an^ Vepor^p, and your answers will not be identified 
to anyone connected wittkyour' employment. /-^ 

I do need this~cover page with your name (a) to/ determine who has 
and has not answered the questionnaire and (b) to conduct any needed 
follow«up. * \ 

Do you have any questions? 

Now | please remove this cover page and pass it in.* 



4(5 
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IfcMean (average) 
3/7<* S.D.=Stahdard deviation 
Fona m NR=No ffesponee 



* Appendix D (coaiji^ue^) 

Minneapolis Public Schools 
ESAA Math-Aide Fona 



Introductory remarks to Aide: I have been employed by the Minneapolis Public Schools 
to help conduct 'the federally required evaluation of the ESAA Project. I would 
like to discuss with you frankly the role of the ESAA Math Aide* I would also 
appreciate your suggestions for improvement of the ESAA Math Component • Names of 
individuals will not appear in any reports, and your answers will not be identified to anyone connected with 
your employment. • 



Contact person: 



Paul Higgins, Eroject ^valuator 
Tel. 348-61*10 
Minneapolis Public Schools 
807 N, £. Broadway 
Minneapolis, KN 55^13 * 



do not fill in 



(1-7) 

(8) Sex 

2_ 1 Male 8# * 

22 2 Female 9^ 

(9) Race or ethnic gro^ip 



Aide's code number 



22. 



71% 



1 White American 
? Black American 

3 Indian American 

4 Spanish -surname d American 

5 Asian American 

6 Other. Please ^specify! 



<M - ii » rjj : 



How many different math clasaed did 
you assist in 1973-7^ that contained 
iCSAA students? 



(i?-i3) 



How many different classes did you 
, assist in 1973-7** that did not con- 

M=0.6, £.D.=+1.6 tain any ESAA students? 

I I \% ^ the total **? c y ^ u e P ont working 

, J face-to-face witttj students, what per- 

M=73?o | S.D # =+26^ cont of tnin timVdid you spend work- 
ing with ESAA students? (Pound to 
nearest 1C#* ) 

Did all the ESAA students in your moth classes use 
MBSDP materials? 



15 
8 



Ye* 

No 



626 
33$ 



If your anwp Gas "No," please explain why HBSDP 
material,:: were not. unod; 



1 NR 



(\7) How much Interest did the ESAA student* show toward 
the MICTI materials? Check one: 



8_ 

"o 



7 "Extremely high interest 

f> Very high interest 

5 High interest 

h Moderate interest 

3 .Slight, interest 

;» very slight interest 

1 No interest at all 



J>JA 
CPA 



Do you hove any comments, criticisms, or suggestions 
concern ing the HBSDP materigln? 

1 NR 



J 



Wo 



9 

ERIC 



ClS) Do you now perform ony duties that you feel you 
should not perform? 

2 1 Yes Q# 

22 a "° 92# 

If you answered "Yen-i" please describe the 
activitien: 



(19) Are there duties you don 1 1 perform that you feel 
you should be performing as a Math Aide? Are there 
things you don't do that you should bo doing^) 

1 1 Yos k% * ' 

23 2 No 96$ 

If you answered "Yes," please describe the 
activities: 



(20) How would you describe your working relationship 
with the teacher(s) you assist? Check one; 



6 Excellent 
5 Very good 
h Good 
3 Fair 

2 Poor 

3 Very Poor 



58*. 
29# 



If you feel the relationships ) could be improved, 
describe how improvement might be made: 



(Pi) Do you think the ESAA Moth Component— which includes 
Math Aides and MBSDP materials— should be changed in 
any way next year in your school? 



Ja- 
il 



1 Yes lf2# 

2 No C k&/> 

3 Uncertain 



If you answered "Yes" or "Uncertain ,'• pleane explain: 

2 NR 8% 



4'fi 



kO 



form 4M 



Appendix D (continued) 



The role of the Hath Aide ? listed below are *ome Activities that Math Aides might perform* For 
each activity plea**, indicate (a ) Do you perform the activity? (b) How do you perform the activity? 
(c) What £ of your total time do you estimate you spend on this activity? 



Activity 



Do you perform 

tho activity? 



How do you perform the activity? 
(include any "tips 11 you would giver 
td others wanting to help ESAA 
students master mathematics.) 



What % of your 
total time do you 
spend "on this 
activity? (jUound, 
to ne arest 

b&k) M — 



"535. 



I, PaGeing out and collecting math 
materials. . 



(22) 



22 ,1 Yeo 
2 ZMo 



92$ 



2. Helping individual students to do 
their work* ♦ 



T23T 



23 1 Yeo 
1 ? No 



9W 



3. Hoi ping craoU. groups of students 
to do their work. 



22 1 Yen 
2 ? No 



92* 



C35-3P) 



(39-'to) 



?! +26 



Passing out and monitoring toots. N 



(35) 



22 1 Yen 

2 a no 



92* 

8# 



Ui-te) 



+ 5 



5# Giving feedback to students 
concerning their classroom 
performance. 



7EF 



20, 1 Yes 
T 2 No 



i?# 



6. Selecting, finding, or writing 
x materials to supplement tho MBSPP 



27) 



/ 



10 1 Yob 
l*f 2 No 



42o 



753-W 



k $ +5 



* +6 



7. Aeeioting the classroom teacher 
in lesson planning. 



(26T 



° 1 Yeo 
18 2 No 



25# 

75# 



s< +2 



8. Organizing and storing the MBSDP 
materials (including, ordering of 
materials ), \ f 



T29T 



10 2 No 



5&# 



WW 



0 2 



WW 



+ 4 



'K Scoring tor.ti. and other writtin 
materials. 



TSoT 



23 A Yes 
1 2 No 



9<$ 



+11 



10. Maintaining student records 
C including unit completions^ 
test score';, grades, attendance)* 



20 l Yes 
k 2 No 



170 



±5 



11. Do you perform any other 
activities as an ESAA Math 
Aide? 



1$ 1 Yes 
9 2 No 



List these "other" activities: 

s& 

3$ 



# +17. 



*Aftor your first anawro on this ooctian, you nay need to revise the #'s, 
m Total in 1005»!. • ' * 



ERIC 



47 
4x 



(Total 10C# 



( r / r «-7 ( » Hiank 
(80) 1 Card number 



Minneapolis Public Schools 



Educational Services Division- 
Planning, Development and Federal Programs 

Harr^ N. Vakos, PhD., Assistant Superintendent 
Educational Services* 

Planning and Developnent 

Lawrence Moon, PhD. ^ Director of $ 
Planning, Development and Federal 
Programs ; "* 

Mary C. Kasbohm, Assistant Director of 
\. Planning, Development and ..Federal 

Programs 

Wallace J. Sjfolar, Fiscal Manager - q 
Etama N, Hudson,. Coordinator, Title I EfflfiA. 
Ruby M. Kiney, Coordinator, Title I ESEA 
Marge Hols, Dissemination Specialist 1 
Rebecca S»- Howard, Dissemination Specialist 



Research and Evaluation 

Richard W. Faunce, PhD., Director of 
Research and Evaluation 

Lary R* Johnson, Research Associate*' 

Robert L. Bergeth, PhD* , Title I Evaluator 

Sara H. Clark, Title I Evaluator 1 

Bonna Wesset, Administrative Assistant 

Thomas McCormick, Title X Research Assistant 



